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(54) Improvements in or relating to image display systems 



(57) A video processing unit (1 3) that decodes com- 
pressed video data and resizes the image represented 
by the video data. The video processing unit (13) has 
two processing engines -- a decoding engine (24) and a 
scaling engine (25), which share a memory (23). A 
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memory manager (22) handles data requests from the 
two engines, and handles reading and writing of the 
memory (22). 
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Description 

TECHNICAL FIELD OF THE INVENTION 

This invention relates to image display systems that 
use spatial light modulators (SLMs), and more particu- 
larly to an integrated circuit for decoding compressed 
input signals to generate images and for resizing the 
images to match the SLM display size. 

BACKGROUND OF THE INVENTION 
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Video display systems based on spatial light modu; 
lators (SLMs) are increasingly being used as an alterna- f 
tive to display systems using cathode ray tubes (CRTs). ^ is 
SLM systems provide high resolution displays without ' 
the bulk and power consumption of CRT systems. They 
are all-digital, with both digital processing and display. In 
other words, a digital input signal can be received, or an 
analog signal can be received and digitized, with subse- 20 
quent processing and display of the data in digital form. 

Digital micro-mirror devices (DMDs) are a type of 
SLM, that may be used for display applications. A DMD * 
has an array of micro-mechanical display elements, 
each having a tiny mirror that is individually addressable 25 
with an electronic signal. Depending on the state of its 
addressing signal, each mirror tilts so that it either does 
or does not reflect light to the image plane. The mirrors 
are often referred to as "pixels", to correspond to the 
pixels of the image they generate, but they are more 30 
correctly referred to as "display elements". Generally, 
displaying pixel data is accomplished by loading mem- 
ory cells connected to the display elements. Each mem- 
ory cell receives one bit of data representing an "ON " or 
"OFF" state of a display element. The display elements 35 
can maintain their "ON" or "OFF" state for controlled 
display times. 

Other SLMs operate on similar principles, with an 
array of display elements that may emit or reflect light 
simultaneously, such that a complete image is gener- 40 
ated by addressing display elements rather than by 
scanning a screen. Another example of an SLM is a liq- 
uid crystal display (LCD) having individually driven dis- 
play elements. 

For all types of SLMs, motion displays are achieved 45 
by updating the data in the SLM's memory cells at suffi- 
ciently fast rates. To achieve intermediate levels of illu- 
mination, between white (ON) and black (OFF), pulse- 
width modulation (PWM) techniques are used. The 
basic PWM scheme involves first determining the rate at so 
which images are to be presented to the viewer. This 
establishes a frame rate and a corresponding frame 
period. For example, in a standard television system, 
images are transmitted at 30 frames per second, and 
each frame lasts for approximately 33.3 milliseconds, ss 
Then, the intensity resolution for each pixel is estab- 
lished. In a simple example, and assuming n bits of res- 
olution, the frame time is divided into 2 n -1 equal time 



slices. For a 33.3 millisecond frame period and n-bit 
intensity values, the time slice is 33.3/(2 n -1) millisec- 
onds. 

Having established these times, for each pixel of 
each frame, pixel intensities are quantized, such that 
black is 0 time slices, the intensity level represented by 
the LSB is 1 time slice, and maximum brightness is 2 n - 
1 time slices. Each pixel's quantized intensity deter- 
mines its ON-time during a frame period. Thus, during a 
frame period, each pixel with a quantized value of more 
than 0 is w ON" for the number of time slices that corre- 
spond to its intensity. The viewer's eye integrates the 
pixel brightness so that the image appears the same as 
if it were generated with analog levels of light. 

For addressing SLMs. PWM calls for the data to be 
formatted into "bit-planes", each bit-plane correspond- 
ing to a bit weight of the intensity value. Thus, if each 
pixel's intensity is represented by an n-bit value, each 
frame of data has n bit-planes. Each bit-plane has a 0 or 
1 value for each display element. In the PWM example 
described in the preceding paragraphs, during a frame, 
each bit-plane is separately loaded and the display ele- 
ments are addressed according to their associated bit- 
plane values. For example, the bit-plane representing 
the LSBs of each pixel is displayed for 1 time slice, 
whereas the bit-plane representing the MSBs is dis- 
played for 2 n /2 time slices. 

Digital display systems based on SLMs have a fixed 
image size - the SLM is designed to display an image 
of a certain horizontal and vertical resolution. This fixed 
image size of the SLM does not necessarily match the 
image size of the input signal. If this is the case, the 
image must be resized to fit the SLM. This resizing has 
required special processing and memory, with a result- 
ant increase in the cost of the display system. For exam- 
ple, the processing algorithms of image resizers require 
special line buffers capable of delivering the same line 
more than once. 

SLM -based display system must also keep pace 
with other types of display systems with regard to the 
ability to accept input signals carrying compressed 
video data. Existing decompression processors are 
either general purpose processors having special 
decompression programming or are special purpose 
processors designed for use with a host processor. A 
need exists for a processor designed especially for use 
with an SLM-based system. 
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SUMMARY OF THE INVENTION 

One aspect of the invention is a djgi taj vjd eo 
processing unit that receives an input sic 
OTmj5ressec7vkieo data. It decompresses the video data 
and resizes the image represented by the data. The 
processing unit is comprised of two processing 
"engines" a decoding engine for decompression and 
a scaling engine for resizing. These engines share a 
memory, which stores compressed video data for deliv- 
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ery to the decoding engine and also stores the video 
data after decompression for delivery to the scaling 
engine. A memory manager is in communication with 
the decoding engine, the scaling engine, and the mem- 
ory. The memory manager provides data as needed, 
responding to request signals from the decoding engine 
and the scaling engine. It also generates address sig- 
nals for storing data in the memory. 

An advantage of the invention is that sharing of 
memory by the decoding engine and scaling engine 
simplifies the memory requirements of the display sys- 
tem. Specifically, a special line buffer between the 
decoder and image resizer is not necessary as would 
be the case in the absence of a shared memory. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be further described, 
by way of example, with reference to the accompanying 
drawings in which: 

FIGURE 1 is a block diagram of a digital image dis- 
play system, which uses a spatial light modulator to 
generate full -color full-motion displays, and which 
has a video processing unit in accordance with the 
invention; 

FIGURE 2 is a block diagram of the digital video 
processing unit of FIGURE 1; and 
FIGURE 3 is a block diagram of an alternative 
embodiment of the digital video processing unit of 
FIGURE 1. 

DETAILED DESCRIPTION OF THE INVENTION 

FIGURE 1 illustrates an all-digital image display 
system 10 in accordance with the invention. Display 
system 10 comprises a signal interface 11, a video 
processing unit 13, a picture quality -unit 14, a frame 
buffer 15, a spatial light modulator (SLM) 16, a color 
wheel 17, a display optics unit 18, and a timing unit 19. 
FIGURE 1 illustrates only those components of a dis- 
play system significant to main-screen video processing 
and display. Other components, such as might be used 
for processing synchronization signals, audio signals, 
secondary screen features such as closed captioning, 
or graphics displays, are not shown. The following 
description is primarily directed to video processing unit 
13. 

For purposes of this description, system 10 has a 
DMD-type SLM 16. Comprehensive descriptions of 
DMD-based display systems, without the features of the 
present invention, are set out in U.S. Patent No. 
5,079,544, entitled "Standard Independent Digitized 
Video System", U.S. Patent Serial No. 08/147,249, enti- 
tled "Digital Television System", and in U.S. Patent No. 
5,452,024, entitled "DMD Display System", each 
assigned to Texas Instruments Incorporated System 10 
could be used with other types of SLMs, such as LCDs. 



Signal interface 1 1 receives digital input signals, 
such as the digital bitstreams provided by proposed 
advanced television (ATV) standards. For purposes of 
this description, it is assumed that the input signal is a 

5 compressed data signal. For purposes of example, it is 
assumed that the data is compressed in accordance r 
with the MPEG standard and contains the data and tim- 
ing information consistent with that standard. In accord- 
ance with the MPEG standard, the data is in YCbCr 

10 (color difference) format. However, the invention could? 
be useful for systems that receive data compressed by , 
other methods. The input signal into signal interface 1 1 , 
might come from any one of a variety of sources, such 
as a television tuner, a data memory device, or via a 

15 computer network. 

Signal interface 1 1 demultiplexes and buffers the 
input signal, so as to provide compressed video data as 1 
well as audio and timing signals. Signal interface 1 1 has 
appropriate filters and menj^ygr p erforminq^ ese 

20 tasks^ For ^ample^ansMEEG^bitsteeamtmay^r^uir e» 
transport'Tayer : demultjplexinq. 

Video processing unit 13 recei ves compressed 
videojdata from signal interfacej 1. As expl ained below 
in conn e^onlwtrTFI^OpE : 2 (r y ideo processing unit 13 

25 decompresses the data and scales (re-sizes) theTesult- 
ing image to match' the4ispla y„resolution of SLM 16. 

Picture qualify unit (PQU) 14 receives the decom- 
pressed and scaled video data from video processing 
unit 13. This data may be referred to as "YCbCr pixel 

30 data". PQU 14 performs tasks such as colorspace con- 
version and de-gamma. Color space conversion con- 
verts YCbCr data to RGB data. The data may also 
undergo a de-gamma process, which linearizes the 
RGB data by removing the effect of a gamma correction 

35 that is processed into video signals at transmission. 
PQU 14 may also perform error diffusion to reduce 
quantization artifacts. 

Frame buffer 1 5 receives processed pixel data from 
PQU 14. It formats the data into "bit-plane" format, and 

40 delivers the bit-planes to SLM 1 6 one at a time. As dis- 
cussed in the Background, the bit-plane format permits 
each display element of SLM 1 6 to be turned "ON " or 
"OFF" in response to the value of one bit of data at a 
time. The formatting is performed by hardware associ- 

45 ated with frame buffer 1 5. 

In a typical display system 10, frame buffer 15 has 
a "double buffer" memory, which means that it has a 
capacity for at least two display frames. The buffer for 
one display frame can be read out to SLM 16 while the 

so buffer for another display frame is being written. The two 
buffers are controlled in a "ping-pong" manner so that 
data is continuously available to SLM 16. 

The bit-plane data from frame buffer 1 5 is delivered 
to SLM 16. Details of a suitable DMD-type SLM 16 are 

55 set out in U.S. Patent No. 4,956,619, entitled "Spatial 
Light Modulator", which is assigned to Texas Instru- 
ments Incorporated. Essentially, SLM 16 uses the data 
from bit-plane buffer 15 to address each display ele- 
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ment of its display element array. The "ON" or "OFF" 
state of each display element forms an image. During a 
frame period, SLM 16 generates an image for each of 
three different colors (red, green, and blue) of a picture. 
These three images are sequentially displayed through 5 
a color wheel 17. The viewer's eyes integrate the 
sequential images so that the viewer perceives a full- 
color picture. 

Display optics unit 18 has optical components for 
illuminating SLM 16, for receiving the image from SLM 10 
16, and for projecting the image to a screen or other 
image plane. These components include a light source, 
illumination path optics, and a projection lens. 

In other embodiments, three SLMs could be used to 
concurrently display images of three colors, such as is 
red, green, and blue. These images would be optically 
combined and perceived by the viewer as a full-color 
image. Still other embodiments might use two SLMs 
with images of different colors being either sequential or 
combined. 20 

Master timing unit 19 provides various system con- 
trol functions. Timing unit 19 may be implemented with 
a field programmable gate array (FPGA), to handle dif- 
ferent frame resolutions and frame rates. 

FIGURE 2 is block diagram of digital video process- 25 
ing unit 13. As explained-below,_video proces sing unit 
13"t ffffi5ines d ecompres sion an d image resizing opera- 
tions. Separate processing^ei^ines^A andj^perform 
thSslTbperations, first decompression i. and Jxen resiz- 
ing. These engines24 and 25 share a memory_23 that 30 
stores the data to be operated onTA requested riven- 
memory manager 22 handleslhe tasks of sy gplying the 
^ proper data at the proper ti me to ea ch engi ne 24' grief 
25. ' ~ ^ 

A feature of the invention is that the components of 35 
video processing unit 13 are de^gnjecLSQibaUbey can j 
A be fabricated with integrated circuit s. For -example, th e 
( \ processing engines 24 and 25 and the memory man- 
\ ager 23 might be fa bricated as o ne integrated circuit. 
* This type of circuit is often referred to as an Ablu (appli- j 40 
\ycation specific integrated circuit), with the applications ' 
being decompression and re-sizing of digital image 
data. As another example, memory 23 might also be 
"on-chip", such that the entire video processing unit 13 
is a single integrated circuit. fts 

Control interface 21 may be included to handle y ar- t 
ious control s ignals. For Example, cqntro^nterface 21 > 
might receive and handle signals that .support* on- , 
screen displays or override s^ngjpr.a gjrtu^jn^-pic- 
ture. If included, control interface 21 would typically so 
interface to a main system r proeessor of system ,1 0. 

Memocy <1B rnanager 22 receive s the_com pressed * 
video data^aricf stores it in jrnemo cy^23. Memory man- 



ager 22 handles the task of providing the appropriate 
dataatlhe appropriate tim es to decoding engine 24 and,' 
scaljng ^n riine 25.' ThelSpecific tasks of memory man- 
ager 22 are to: extract compressed data from interface t 
1 1 and place it in memory 23, move compressed data e 
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from memory 23 to decoding engine 24, move decom- 
pressed data from decoding engine 24 back into mem- 
ory 23,/move decompressed data from memory 23 to; 
scaling engine 25, and arbitrate any conflicting requests 
for data from the decoding engine 24 and the scaling 
engine 25. 

Memory manager 22 is re quest-drive n, in that data-r 
is delivered to decoding engine 24 and scaling engine ' 
25 in response to requests for data from these engines. * 
Memory manager 22 may be implemented as a hard- 
coded micro-controller. 

Memory 23 may be comprised of conventional 
dynamic random access memory devices (DRAMs). 
The size of memory 23 is related to various factors, • 
such as the image resolution and the compression ratio. , 
Typically, memory 23 is sufficiently large to permit simul- 
taneous storage of at least part of a frqme -oLco m- 
press ed data b eing reacjjru a fr ame be ing pr ocess 

read out. A typi cal si ze of njemof y 23^^^ ' 

A memory b us 22a be tweejjflggra^ 22 
and memory 23 carries data, addres ses,_and the control 
signals necessary for reading and writing memory 23. 
The control signals include a write enable'ahd column 3 
and row address strobes. ^ 

Decoding engine 24 is a processor programmed to |! 
decompress the video data. It may be programmed to 
support various compression standards, such as the 
JPEG, MPEG, MPEG2, Px64, CCITT, etc. The grg^ 
gramming can be for either still or full-motion deaDm-^ 
pressiorTaj ^nthms . Decddirig" engine*^ could be a 
multi-form^t_decoding engine, "switchable between \ 
decompression algorithms so as to perform whatever-, 
decompression method is appropriate for the input sig- ' 
nal. The output of decoding engine 24 is decompressed 
pixel data, which in the example of this description, is in' 
YCbCr format. 

An example of a suitable decoding engine 24 is the 
decoding engine of the CL450 MPEG Video Decoder 
manufactured by C-Cube Microsystems. It provides 
decompressed YCrCb data,^ith an image si ze^cpns ist- ; 
ent withtheinput signal. 

A decoding engine bus 22b carries control informa- • 
tion and data between decoding engine 24 and memory' f 
manager 22. The control information includes requests'/ 
for data from decoding engine 24, which requests data . 
as needed for processing. In response to a request, 1 
memory manager 22 generates the address of the next 
data to be decoded, retrieves the data from memory 23, 
and delivers it to decoding engine 24. Bus 22b is bidi- „ 
rectional - after decompression, decodin g engine 24 
drivers, the data b ack to memory manaqer_22 t whic h ( 
generates a^^re^^ 

Scalin g engin e 25 operates o n the decompre ssed 
vid eo data . EsseritiallyH^lihg engine 25 is a processor 
programmed to scale the image so as to. resize the 
image to the display size (resolution) of SLM 16. As 
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stated in the Background, SLM 16 does not always have 
a display resolution that matches the resolution of the , 
input signal. For example, a typical SLM 16 might have , 
a display resolution of 1280 x 1024, whereas, for HDTV, 
full transmission resolution is 1920 x 1080 pixels. Scal- f J 5 
ing engine 25 upscales or downscales the input signals 
to fit the SLM size in either or both dimensions. Horizon- 
tal scaling changes the number of active pixels per line 
and vertical scaling changes the number of active lines 
per frame. Various scaling algorithms are known in the w 
art of image processing, such as those that use interpel- 
lation or FIR filtering. 

As an example of the scaling process, the image / 
represented by the decompressed data from decoding * 
engine 24 might be smaller than the displaJTsize of SLM' 15 
16, both vertically and horizontally. For vertical scaling/ 
scaling engine 25 would generate new lines of data by 
filtering neighboring lines of the existing image, request- 
ing these neighboring lines as needed. It may need the 
same line more than once during this process. Likewise) 20 
for horizontal scaling, scaling engine 25 would generate 
new pixels by filtering neighboring pixels of the existing \ 
image, requesting them from memory manager 22 as 1 
needed. 

Scaling engine 25 is provided with input and output. 25 
image size parameters. The output size'of the image is^ 
determined by the display size of SLM 16. The input' 
image size is provided by decoding engine 24, which; 
decodes this data from the compressed video data' 
stream. 30 

A scaling engine bus 22c carries control signals < 
and data between scaling engine 25 and memory man- ' 
ager 22. The control signals include requests for data as / 
needed for processing. After scaling, the video data is' 
delivered to PQU 14. 35 

An example of a suitable scaling engine 25 is the 
scaling engine of the Acuity Resizer device, manufac- 
tured by Genesis Microchip, Inc. The Acuity gm833x2 
device operates on YCbCr data, using FIR filters on two 
separate channels. 40 

FIGURE 3 illustrates an alternative embodiment of 
video processing unit 13. A feature-oUhis.embodiment 
is that memory 33 h as two data outp ut pgrjs and deliv- 
ers data directly to decoding engine 24 or to sjgjjng^ 
eng ine,25 TTrTe dual output ports can be used to meet r 45 
high bandwidth demands. Like the embodiment of FIG- 
URE 2, the data is delivered in response to requests 
delivered to memory manager 32. The memory bus 32a , 
carries a signal that indicates the destination of the 
requested data. , so 

Like the embodiment of FIGURE 2, the video- 
processing unit 13 of FIGURE 3 may be easily fabri- 
cated as two int egrated circuits, one for decoding 
engine 24, scalin g engi ne 25, and nriemory^nager 32, 
and the othe r for eto ffi| m o[y aE J3- Alternatively, video ss 
processing unit 13 could be fabricated as a single inte- 
grated circuit. 

Although the present invention has been described 



in detail, it should be understood that various changes, 
substitutions, and alterations can be made hereto with- f 
out departing from the spirit and scope of the invention. 

Claims 

1 . A digital video processing unit comprising: 

a decoding engine for decompressing com- 
pressed video data received on an input signal, 
thereby providing decompressed video data; 
a scaling engine for scaling said decom- 
pressed video data; 

a memory for storing said compressed video 
data prior to delivery to said decoding engine, 
and for storing said decompressed video data 
prior to delivery to said scaling engine; and 
a memory manager in data communication 
with said decoding engine, said scaling engine, 
and said memory, said memory manager being 
operable to respond to data request signals 
from said decoding engine and from said scal- 
ing engine, to generate address signals for 
storing data in said memory. 

2. The video processing unit of Claim 1, wherein said 
decoding engine, said scaling engine, and said 
memory manager are formed on a single integrated 
circuit. 

3. The video processing unit of Claim 1 or Claim 2 
wherein said video processing unit is formed on a 
single integrated circuit. 

4. The video processing unit of any preceding claim, 
wherein said scaling engine is operable for resizing 
an image represented by said video data. 

5. The video processing unit of any preceding Claim, 
wherein said memory has a first output port for 
delivering said compressed video data to said 
decoding engine and a second output port for deliv- 
ering said decompressed video data to said scaling 
engine. 

6. The video processing unit of any preceding Claim, 
wherein said memory has a single data port for 
delivering said compressed video data and said 
decompressed video data to said memory man- 
ager. 

7. The video processing unit of any preceding Claim, 
wherein said compressed video data is com- 
pressed in accordance with the MPEG standard 
and wherein said decoding engine is programmed 
to perform MPEG decompression. 

8. The video processing unit of any preceding Claim, 
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wherein said compressed video data is in YCbCr 
format 

9. The video processing unit of any preceding Claim, 
wherein said decoding engine is programmed for s 
decoding input image size data from said com- 
pressed video data and is in data communication 
with said scaling engine for delivering said input 
image size data to said scaling engine. 

10 

10. A video display system comprising: 

a signal interface for receiving a compressed 
video signal; 

a video processing unit having a decoding is 
engine for decompressing said compressed 
video data thereby providing decompressed 
video data, a scaling engine for resizing said 
decompressed video data to match a delivered 
display size thereby providing a first format 20 
pixel data, and a shared memory accessible by 
said decoding engine and said scaling engine; 
a picture quality unit operable to convert said 
first format pixel data to a second format pixel 
data; and 25 
a frame buffer operable to format said second 
format pixel data into bit-plane format and to 
deliver said second format pixel data to a dis- 
play said display being operable to display 
images based on said second format pixel data 30 

1 1 . The video display system of Claim 1 0, wherein said 
display comprises a spatial light modulator opera- 
ble to display images based on said second format 
pixel data. 35 

1 2. The video display of Claim 1 0 or Claim 1 1 , wherein 
said first format pixel data comprises YcbCr pixel 
data. 

40 

13. The video display of any of Claims 10 to 12, 
wherein said second format pixel data comprises 
RGB pixel data. 

1 4. The video display system of any of Claims 1 0 to 1 3, 45 
wherein said decoding engine and said scaling 
engine are formed on a single integrated circuit. 

1 5. The video display system of any of Claims 1 0 to 14, 
wherein said video processing unit is formed as a so 
single integrated circuit. 

1 6. The video display system of any of Claims 10 to 1 5, 
wherein said memory has a first output port for 
delivering said compressed video to said decoding 55 
engine and a second output port for delivering said 
decompressed video data to said scaling engine. 
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1 7. The video display system of any of Claims 1 0 to 1 6, 
wherein said video processing unit further com- 
prises a request-driven memory manager. 

1 8. The video display system of Claim 1 7, wherein said 
first processor, said second processor, and said 
memory manager are formed on a single integrated 
circuit. 

19. The video display system of Claim 17 or Claim 18, 
wherein said memory has a single data port for 
delivering said compressed video and said decom- 
pressed video data to said memory manager. 

20. The video display system of any of Claims 10 to 19, 
wherein said compressed video data is com- 
pressed in accordance with the MPEG standard 
and wherein said decoding engine is programmed 
to perform MPEG decompression. 

21. A method of providing video data for use in a video 
display system, comprising the steps of: 

receiving an input signal carrying compressed 
video data: 

storing said data in a video processing mem- 
ory; 

decompressing said compressed video data, 
said compressed video data being delivered 
from said video processing memory, thereby 
providing decompressed video data; 
storing said decompressed data in said video- 
processing memory; and 
scaling said decompressed video data to 
match a determined display size, said decom- 
pressed video data being delivered from said 
video processing memory. 

22. The method of Claim 21 , wherein said step of scal- 
ing said decompressed video data comprises resiz- 
ing said decompressed video data such that said 
image represented by said video data substantially 
corresponds to said display size. 

23. The method of Claim 21 or Claim 22, further com- 
prising providing a spatial light modulator for form- 
ing a display. 

24. The method of any of Claims 21 to 23, further com- 
prising delivering said compressed video data and 
said decompressed video data in response to 
requests for data during said decompressing and 
scaling steps. 

25. The method of any of Claims 21 to 24, wherein said 
decompressing step comprises generating input 
image size data and performing said scaling step is 
by using said input image. 
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